Skip to content

[Klaud Cold] Add day-0 MiniMax-M3.1-Flash B200 vLLM AgentX DSpark recipe / [Klaud Cold] 新增 MiniMax-M3.1-Flash B200 vLLM AgentX DSpark 首日配方 - #4426

Merged
Oseltamivir merged 4 commits into
mainfrom
feat/minimaxm31flash-b200-dayzero
Oct 23, 2026
Merged

Oseltamivir merged 4 commits into
mainfrom
feat/minimaxm31flash-b200-dayzero

Conversation

@Oseltamivir

Copy link
Copy Markdown
Collaborator

Summary

Day-0 MiniMax-M3.1-Flash (MiniMaxAI/MiniMax-M3.1-Flash, ~428B/23B active, MXFP8 dense + NVFP4 experts, QAT for an NVFP4 KV cache) AgentX recipe on B200 with DSpark, following the vLLM day-0 blog and recipes.vllm.ai. B300 is in #4421, which also adds the docs/MODELS.md row.

  • Key: minimaxm31flash-fp4-b200-vllm-agentic-dspark, recipe minimaxm31flash/vllm/b200-fp4-mtp/agentic.yaml.
  • Image: vllm/vllm-openai:minimax-m31-flash@sha256:86f582da… (day-0 multi-arch build, verified on Docker Hub).
  • Serve flags (Blackwell TP4 recipe): block-size 128, kv-cache-dtype nvfp4, attention-config {"indexer_kv_dtype":"nvfp4","use_prefill_query_quantization":true}, FULL_AND_PIECEWISE cudagraphs, disable-hybrid-kv-cache-manager, minimax_m3 reasoning/tool parsers, language-model-only, VLLM_FLOAT32_MATMUL_PRECISION=high.
  • DSpark with the checkpoint's built-in drafter: {"method":"dspark","attention_backend":"FLASH_ATTN","kv_cache_dtype":"fp8","draft_sample_method":"probabilistic","rejection_sample_method":"block"}. Throughput runs use synthetic acceptance from the golden curve minimaxm31flash_dspark.yaml ([Klaud Cold] Add MiniMax-M3.1-Flash DSpark golden AL curve and SPEED-Bench collector / [Klaud Cold] 新增 MiniMax-M3.1-Flash DSpark 黄金 AL 曲线与 SPEED-Bench 采集脚本 #4425).
Arm Concurrency DSpark tokens Golden AL
TP4 1, 4, 8, 16, 32 7 (vLLM blog GB300 AgentX frontier) 4.04
DEP4 (TP1 × DP4 + EP4, vllm-router consistent-hash) 64, 128 (B200 holds less KV per rank than B300) 3 (recipes.vllm.ai Blackwell) 2.88

…h B200 DSpark recipe

TP4 drafts 7 DSpark tokens, DEP4 drafts 3; throughput runs use the
minimaxm31flash_dspark golden AL from #4425.
@github-actions

Copy link
Copy Markdown
Contributor

Thanks for the contribution!

  • Review: If this PR changes files owned by someone other than a repository admin or @SemiAnalysisAI/core, ask one eligible CODEOWNER to complete the latest PR_REVIEW_CHECKLIST.md before contacting a core maintainer on Slack. Follow the template exactly, including As a PR reviewer and CODEOWNER, I have reviewed this and have, so sign-off verification triggers.
  • PR verification: Sweeps run only when the PR appends an inferencex-e2e/perf-changelog.yaml entry and carries exactly one primary label: full-sweep-fail-fast (strongly recommended; canary plus per-matrix fail-fast), full-sweep-enabled (canary; matrix jobs continue after a failure), or non-canary-full-sweep-enabled (no canary or fail-fast). The modifiers all-evals, evals-only, and agentx-fast require a primary label. On fork PRs, a maintainer applies the label. See sweep labels and reuse.
  • After merging: PR authors must ensure all GitHub Actions jobs pass. Transient failures often pass on rerun; see how to rerun failed jobs.
中文

感谢你的贡献!

  • **审阅:**如果 PR 修改的文件归属于仓库管理员及 @SemiAnalysisAI/core 之外的 CODEOWNER,请先联系一位有资格的 CODEOWNER 填写最新的 PR_REVIEW_CHECKLIST.md,再通过 Slack 联系核心维护者。必须严格遵循模板,并保留 As a PR reviewer and CODEOWNER, I have reviewed this and have,才能触发签核验证。
  • **PR 验证:**只有当 PR 在 inferencex-e2e/perf-changelog.yaml 末尾追加了条目,并且恰好带有一个主标签时,才会运行扫描:full-sweep-fail-fast(强烈推荐;canary 加逐矩阵 fail-fast)、full-sweep-enabled(有 canary;矩阵任务在失败后继续运行)或 non-canary-full-sweep-enabled(无 canary,也无 fail-fast)。修饰标签 all-evals、evals-only 和 agentx-fast 必须与主标签一起使用。fork PR 的标签由维护者添加。参见扫描标签与复用。
  • **合并后:**PR 作者必须确保所有 GitHub Actions 任务通过。临时性失败通常可以通过重新运行恢复;参见重新运行失败任务的说明。

@Oseltamivir Oseltamivir added the full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended) label Oct 23, 2026

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Findings marked 🟡 are optional suggestions and need no follow-up push.

Comment thread inferencex-e2e/perf-changelog.yaml Resolved
@github-actions

Copy link
Copy Markdown
Contributor

@Oseltamivir

Copy link
Copy Markdown
Collaborator Author

/use 39904043266

@github-actions

Copy link
Copy Markdown
Contributor

@Oseltamivir staging run 39904043266. Existing staged runs will be preserved; a completion link will be posted here.

@Oseltamivir
Oseltamivir merged commit ae21092 into main Oct 23, 2026
34 checks passed
@Oseltamivir
Oseltamivir deleted the feat/minimaxm31flash-b200-dayzero branch October 23, 2026 08:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

full-sweep-fail-fast Full sweep with canary gate; first failure cancels the rest of that matrix (recommended)

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

1 participant